ADS88967 


Tsckaical  Rsssarck  Hots  206 


AD 


i 


EFFECT  OF  DISPARITY  IH  PHOTO  SCALE 
AND  ORIENTATION  ON  CHANGE  DETECTION 


C.  L  "Mngberg  and  C.  L.  Elworth, 
i  he  Boeing  Company 

and 

’Abraham  H.  Birnbaum, 

U.  S.  Army  Behavioral  Science  Research  Laboratory 


l  * 

JUl'i  *  *'^3 


11.  S.  Army 

Behavioral  Science  Research  Laboratory 


3 

H 

'i 


i 

vS 


--•rt 


•-is 

>4 


January  1969 


This  document  has  been  approved  tor  public  release  and  sale,  its  distribution  is  unlimited. 


Reproduced  by  tho 

CLEARINGHOUSE 
for  Federal  Scientific  &  Tixhn._„l 
Information  Springlioid  V.i 


BEHAVIORAL  SCIENCE  RESEARCH  LABORATORY 

An  activity  of  the  Chief,  Research  and  Development 


J.  E.  UHLANER  JAMES  E  WIRRICK 

Director  COL,  GS 

Commanding 


Research  accomplished 
i  under  contract  to  the  Department  of  the  Army 

!  I 

^The-Boding  Company 


NOTICES 


DISTRIBUTION'  Primary  distribution  ot  this  report  has  been  made  by  BESRl.  Please  address 
correspondence  concerning  distribution  of  reports  to:  U.  S.  Army  Behavioral  Science  Research 
Laboratory,  Attn:  CRQBSRL,  Room  239.  Commonwealth  Building,  1 320  Wilson  Blvd.,  Arlington, 
Virginia  22209. 


FINAL  DISPOSITION:  This  report  may  be  destroyed  when  it  is  no  longer  needed.  Please  do  not 
return  it  to  the  U.  S.  Army  Behavioral  Science  Research  Laboratory. 


NOTE:  The  findings  in  this  report  are  not  to  be  construed  as  an  official  Department  of  the 
Army  position,  unless  so  designated  by  other  authorized  documents. 


T*ck*lc*l  lunnk  Not*  206 


AD 


EFFECT  OF  DISPARITY  IN  PHOTO  SCALE 
AND  ORIENTATION  ON  CHANGE  DETECTION 


C.  L.  Klingberg  and  C.  L.  Elworth, 

The  Boeing  Company 

and 

Abraham  H.  Birnbaum, 

U.  S.  Army  Behavioral  Science  Research  Laboratory 


Abraham  H.  Birnbaum,  Program  Director 


SUPPORT  SYSTEMS  RESEARCH  DIVISION 
Joseph  Zeidner,  Chief 


U.  S.  ARMY  BEHAVIORAL  SCIENCE  RESEARCH  LABORATORY 

Office,  Chief  of  Research  and  Development 
Department  of  the  Army 

Room  239,  The  Commonwealth  Building 
1320  Wilson  Boulevard,  Arlington,  Virginia  22209 


January  1969 


Army  Project  Number 
2Q662704 A721 


Contract  No.  DA-49-092  ARO-92 
Interpreter  Techniques  a-51 


This  document  has  been  approved  for  public  release  and  sale;  its  distribution  is  unlimited. 


8ESRL  Technical  Research  Reports  and  Technical  Reseaich  Notes  are  intended  for 
sponsors  of  R&D  tasks  and  other  research  and  military  agencies.  Any  findings 
ready  for  implementation  at  the  time  of  publication  are  presented  in  the  latter  part 
of  the  Brief.  Upon  completion  of  a  major  phase  of  the  task,  formal  recommenda¬ 
tions  for  official  action  normally  are  conveyed  to  appropriate  military  agencies 
by  briefing  or  Disposition  Form. 


FOREWORD 


The  Surveillance  Systems  research  program  of  the  U.  S.  Army  Behavioral  Science 
Research  Laboratorv  has  as  its  objective  the  production  of  scientific  data  bearing  on  the 
extraction  of  information  from  surveillance  displays  and  the  efficient  storage,  retrieval, 
and  transmission  of  this  information  within  an  advanced  computerized  image  interprets* 
tion  facility.  Research  results  are  used  in  future  systems  design  and  in  the  development 
of  enhanced  techniques  for  all  phases  of  the  interpretation  process.  Research  is  con¬ 
ducted  under  Army  RDT&E  Project  2Q662704A721 ,  "Surveillance  Systems:  Ground  Surveil¬ 
lance  and  Target  Acquisition  Interpreter  Techniques,"  FY  1969  Work  Program. 

BESRL  research  in  this  area  is  conducted  as  an  in-house  research  effort  augmented 
by  research  contracts  with  organizations  selected  as  having  unique  capabilities  and  facili¬ 
ties  for  research  in  aerial  surveillance.  The  present  study  was  conducted  jointly  by  per¬ 
sonnel  of  the  Boeing  Company  and  of  the  Behavioral  Science  Research  Laboratory  under 
program  direction  of  A.  H.  Birnbaum. 

The  INTERPRETER  TECHNIQUES  Work  Unit  undertakes  the  development  of  methods 
and  procedures  which  maximize  the  accuracy,  completeness,  and  speed  with  which  intelli¬ 
gence  information  is  derived  from  imagery,  both  conventional  aerial  photographs  and  the 
products  of  advanced  sensor  techniques.  The  present  publication  reports  on  a  study  of  the 
need  for  devices  to  rectify  disparity  in  photo  scale  and  orientation  in  comparative-cover 
photos  as  n>eans  of  facilitating  detection  of  change  in  the  status  of  targets  in  the  area. 


J.  E.  UHLANER,  Directo 


U.  S.  Army  Behavioral  Science 


Research  Laboratory 
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EFFECT  OF  DISPARITY  IN  PHOTO  SCALE  AND  ORIENTATION  ON  CHANGE  DETECTION 


BRIEF 


Requirement: 

To  determine  the  importance  of  incorporating  photo  scale  rectification  and  rotational 
capability  in  display  systems  for  image  interpreters  concerned  with  detecting  changes  in 
comparative  cover  aerial  imagery, 


Procedure. 

The  experiment  assessed  the  effects  for  three  levels  of  scale  discrepancy  (1  :1,2;  1, 
and  4:1),  three  levels  of  orientation  misalignment  (0  90°, and  180°)  and  two  different 
time  limits  (3  minutes  and  6  minutes)  on  the  completeness  and  accuracy  of  change 
detection.  The  experiment  was  conducted  under  two  requirements,  one  in  which  the  inter* 
prater  detected  change  in  objects  characterized  only  as  target  or  non*target.  the  other 
requiring  identification  of  the  target  as  belonging  in  one  of  nine  categories.  Subjects  were 
36  student  image  interpreters  at  the  U.  S.  Army  Intelligence  School. 


Findings: 

Significant  decrements  in  both  completeness  and  accuracy  of  target  change  detection 
were  associated  with  scale  disparity  and  with  orientation  misalignment  when  target  identi¬ 
fication  was  not  required. 

When  target  identification  was  required,  scale  discrepancy  resulted  in  significant 
decrement  in  accuracy  as  well  as  completeness,  whereas  orientation  misalignment  resulted 
in  lower  completeness  but  not  lower  accuracy 

Completeness  but  not  accuracy  of  change  detection  with  or  without  target  identifica¬ 
tion  was  higher  with  the  longer  time  limit. 


Utilization  of  Findings: 

Inclusion  of  scale  rectification  and  orientational  alignment  capabilities  in  systems 
used  to  display  comparative-cover  imagery  was  strongly  supported  by  the  results  obtained, 
and  has  been  recommended  for  operational  facilities. 
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THE  PROBLEM 

A  frequent  and  Important  requirement  of  image  interpreters  is  to 
determine  whether  changes  have  occurred  in  a  given  area  since  prior  photo 
coverage  was  obtained.  Such  "change  detection"  usually  concerns  possible 
change  in  the  presence  or  deployment  of  targets.  The  interpreter's  task 
is  assumed  to  be  easier- -and  his  performance  better- -when  the  photos  he 
is  comparing  are  the  same  scale,  taken  from  the  same  angle,  and  under 
similar  weather  and  lighting  conditions,  in  short,  when  they  are  com¬ 
parable  in  every  respect  except  for  possible  change  in  content.  This 
ideal  state  seldom  occurs.  Nor  can  early  and  late  photos  be  made  in 
every  way  comparable.  However,  photo  scale  and  photo  orientation  can  be 
manipulated  to  compensate  for  much  of  the  discrepancy  in  the  comparative 
cover. 

The  objective  of  the  present  study  was  to  estimate  the  extent  to 
which  the  completeness  and  accuracy  of  interpreters'  reports  of  change 
are  dependent  on  the  essential  equivalence  of  the  imagery  being  compared, 
and  to  determine  the  desirability  of  incorporating  scale  rectification 
and  rotational  capability  in  systems  for  displaying  comparative  cover  to 
interpreters.  A  secondary  objective  was  to  establish  the  amount  of  scale 
disparity  in  comparative -cover  photos  the  interpreter  can  tolerate  before 
his  performance  is  adversely  affected.  By  measuring  interpreter  perform¬ 
ance  at  various  points  along  the  scale-discrepancy  continuum,  the  approxi¬ 
mate  point  at  which  scale  rectification  should  be  a  display  system  re¬ 
quirement  can  be  calculated.  With  respect  to  misalignment,  interpreters, 
given  free  access  to  the  two  photographs  of  a  comparative  pair,  will 
frequently  manipulate  the  two  pictures,  orienting  one  relative  to  the 
other  so  that  the  most  direct  point-to-point  comparison  can  be  made. 

When  photos  are  not  amenable  to  manual  manipulation,  special  devices  for 
orienting  one  or  both  photos  may  be  part  of  the  display  system,  or  the 
interpreter  may  have  to  perform  his  analysis  with  whatever  misalignment 
exists.  Mental  processes  similar  to  those  postulated  by  Boynton  et  al^ 
as  being  involved  in  making  same-different  form  judgments  of  adjacent 
pair  members  appear  to  be  equally  appropriate  for  the  photo  interpreter 
making  target  change  judgments: 


JL^ 

Boynton,  R.  M.,  C.  L.  Elworth,  R.  Monty,  Judith  W.  Onley,  and  C.  L, 
Kllngberg.  Overlay  as  a  predictor  of  form  discrimination  under  supra 
threshold  conditions.  Technical  Report  RADC-TR-61-99*  Rome  Air 
Development  Center.  June  I96I. 
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"It  Is  suggested  that  the  ability  of  human  beings  to 
judge  whether  two  forms  are  of  the  same  or  different 
shape  depends  upon  brain  processes  which  in  effect 
allow  for  some  kind  of  internal  overlap  comparison. 

Such  a  comparison  would  require  operations  by  a  cerebral 
computer  wi  ch  somehow  'rotates'  the  coded  representa¬ 
tion  of  the  form  and  allows  areal  adjustments  prior  to 
the  same-different  test.  Such  'rotation'  is  difficult 
under  impoverished  . iewing  conditions  but  becomes  rela¬ 
tively  easy  and  natural  under  good  viewing  conditions, 
where  'rotation'  is  in  effect  automatic  and  difficult 
to  inhibit,  but  takes  a  finite  time."  (Page  43) . 

In  the  present  study,  three  levels  of  scale  disparity  and  three 
levels  of  orientation  misalignment  were  selected  for  investigation. 

There  seems  ample  evidence  to  support  a  generalization  that  the  greater 
the  number  and  complexity  of  mental  manipulations  required  in  making  a 
judgment,  the  longer  it  will  take  to  arrive  at  a  judgment.  Thus,  com¬ 
parisons  requiring  a  single  lateral  translation  of  comparison  data  where 
no  scale  or  orientation  discrepancy  exists  could  presumably  be  accom¬ 
plished  more  rapidly  than  if  magnification  and/or  rotation  were  also 
required.  Since  potential  differences  in  rate  of  information  extraction 
could  well  be  obscured  if  subjects  were  given  unlimited  time  to  perform 
the  task,  performance  measures  were  obtained  for  two  different  time 
limits  to  permit  comparison  of  output  rate  for  the  various  combinations 
of  scale  and  orientation  discrepancy. 

METHOD 

Experimental  Design 

The  three  levels  of  scale  discrepancy  included  one  in  which  the 
scale  of  each  of  the  two  images  of  a  comparative  pair  were  t  e  same 
(  A  scale  ”1  :  l),  one  in  which  the  scale  of  the  earlier  image  was  one- 
half  that  of  the  later  (  A  scale  =  2  :  1),  and  one  in  which  the  earlier 
coverage  was  one-fourth  that  of  the  later  (  A  scale  =  4  :  1) . 

The  first  of  the  three  levels  of  rotational  discrepancy  was  zero 
(A  orientation  =  0°);  that  is,  the  flight  path  of  the  aircraft  obtaining 
the  later  imagery  was  in  the  same  direction  as  during  the  flight  in  which 
the  earlier  imagery  was  acquired.  The  93°  discrepancy  condition 
(  a  orientation  =  90°)  was  representative  of  an  imagery  pair  produced 
when  the  flight  paths  of  the  two  reconnaissance  sorties  were  perpendicular 
to  each  other.  The  l80°  discrepancy  condition  (  A  orientation  =  180°) 
was  comparable  to  comparison  photos  obtained  from  aircraft  flying  the 
same  flight  path  but  in  the  opposite  direction. 


Two  time  limits,  three  minutes  and  six  minutes,  were  selected  as 
being  sufficiently  long  to  provide  an  adequate  sampling  of  interpreter 
performance  and  lisparate  enough  to  permit  differential  output  rates  to 
be  accurately  reflected  in  the  performance  measures. 

The  10  experimental  conditions  are  shown  schematically  in  Figure  1. 
To  distribute  the  effects  associated  with  individual  differences  and 
differences  in  photo-pair  difficulty  equally  across  all  treatment  con¬ 
ditions,  subjects  were  assigned  to  the  various  treatment  combinations 
according  to  the  two  orthogonal  Latin  square  matrices  shown  in  Table  1. 
Each  subject  participated  under  each  experimental  condition  and  saw  each 
of  the  18  photo  pairs  once.  Each  photo  pair  was  viewed  by  two  different 
subjects  under  each  of  the  treatment  conditions. 


ORIENTATION  DISCREPANCY 
( &  orientation  ) 


Figure  I.  Schematic  representation  of  experimental  conditions  investigated 
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ASSIGNMENT  SCHEDULE  FOR  SUBJECT/PHOTO  COMBINATIONS 


Subjects 


Subjects  were  36  enlisted  men  attending  the  Image  Interpretation 
course  at  the  U.  S.  Army  Intelligence  School,  Fort  Holabird,  Maryland. 
All  were  at  approximately  the  same  stage  in  their  training  program, 
having  completed  12  weeks  of  the  fifteen-week  course. 


The  Experimental  Task 

The  task  to  be  performed  was  the  preparation  of  written  reports 
for  18  different  pairs  of  comparative -cover  scenes  in  which  tactical 
military  targets  appeared.  The  process  of  change  detection  included 
target  detection  and  coordinate  localization  and  identification  of 
targets. 

Change  Detection  without  Target  Identification.  This  level  of 
identification  required  only  that  the  interpreter  state  whether  an  object 
was  a  target  or  a  non-target.  Having  determined  a  detected  object  to  be 
a  target,  the  interpreter  then  checked  the  comparative  photo  to  deter¬ 
mine  whether  the  target  was  present  or  absent  at  the  same  location.  If 
he  found  the  target  present  only  on  the  earlier  imagery,  he  labeled  it 
"Gone”  on  the  second  photo;  if  he  found  the  reverse,  he  labeled  the  tar¬ 
get  "New"  on  the  second  photo.  If  the  object  was  seen  as  present  in  the 
same  location  on  both  photos,  the  interpreter  was  required  to  make  a  same- 
different  judgment  prior  to  assigning  a  change  status  of  "Unchanged"  or 
"Replaced."  Erroneous  change  status  assignments  could  thus  result  from 
one  or  more  of  several  errors:  failure  to  detect  the  presence  of  a  tar¬ 
get  or  targets,  failure  to  distinguish  between  target  and  non-target 
objects,  detecting  an  object  where  there  was  none  (inventive  errors), 
failure  to  translate  accurately  target  locations  in  comparing  photos, 
and  failure  to  make  the  correct  same-different  discrimination. 

Change  Detection  with  Target  Identification.  At  this  level,  the 
interpreter  was  required  to  identify  the  target  as  belonging  to  one  of 
nine  target  categories  listed  on  the  Response  Code  Sheet  (Figure  2). 

Having  detected  and  identified  a  target,  he  proceeded  to  assign  the 
change  status  designation  as  at  the  detection  level.  In  addition,  where 
a  target  was  uniquely  identifiable,  the  change  status  "Moved"  was  appli¬ 
cable  if  the  target  had  been  repositioned  within  the  same  general  area. 

All  sources  of  erroneous  change  status  assignment  cited  above  were  appli¬ 
cable  to  the  Identification  level  of  response,  plus  mlsidentification 
of  detected  targets. 

The  method  of  evaluating  interpreter  performance  placed  maximum 
emphasis  on  the  change  detection  aspect  of  the  task.  In  scoring,  a 
change  status  assignment  was  counted  as  correct  only  when  the  total 
present-absent  and  same-different  comparison  had  been  accurately  performed. 
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RESPONSE  CATEGORIES 

CONFIDENCE  LEVELS 

1.  Tanks 

(includes  M41,  M48,  M60) 

2.  SP  Howitzers  it  Guns 
(includes  M42,  M44,  M53, 

M55,  M56,  M108,  M109) 

C  --  Certain 

FS  --  Fairly  Sure 
D  --  Somewhat 
Doubtful 

G  --  Best  Guess 
?  --  Something 

3.  Armored  Personnel 

Carriers 

(Includes  M59,  Ml 13, 

M114) 

4,  Trucks  -  3/4  Tons  &  Less 
(includes  M37,  M38,  MI5I) 

‘5.  Trucks  -  2-1/2  Tons  & 
Greater 

(includes  M34,  M35,  M36, 

M41,  M54,  M55>  M49) 

6.  Trailers  &  Semi -Trailers 
(includes  Cargo,  Water, 

Gas,  Tank  Transport) 

7.  Engineering  Equipment 
(includes  Cranes, 

Graders,  Scoops, 

Tractors,  etc.) 

8.  Aircraft 

(includes  fixed  & 
rotating  wing) 

9.  Others 

( includes  Wrecker,  M543  & 
M62;  Truck  Tractors, 

M52  &  M123;  Recovery 
Vehicle.  M88;  does  not 
include  Tents,  buildings, 
stock  piles,  roads, 
railroads,  rivers) 

CHANGE  STATUS 

U  --  Unchanged 
M  --  Moved 

(within  area 
N  --  New 
G  --  Gone 
R  --  Replaced 


Figure  2.  Response  Code  Sheet  used  in  the  experiment 
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Materials  and  Equipment 

Photography.  From  Imagery  available  in  the  Technical  Support  Branch 
Film  Library  of  BESRL's  Support  Syatema  Research  Division,  18  pairs  of 
comparative-cover  aerial  photography  were  selected.  Criteria  considered 
in  selection  were: 

1.  That  the  terrain  comuon  to  both  members  of  a  photo  pair  (over¬ 
lap  area)  constitute  the  major  portion  of  each  when  equated  for  scale 
and  format  size. 

2.  That  the  otiginal  photo  scale  permit  the  photo  reduction  neces¬ 
sary  to  obtain  the  required  scale  discrepancies  without  reducing  targets 
to  a  size  obviously  below  detection  threshold. 

3.  That  the  original  photo  quality  be  such  that  enlargement  to  four 
times  the  original  scale  would  not  introduce  excessive  degradation. 

4.  That  a  representative  range  and  frequency  of  target  types  be 
included. 

3.  That  the  types  of  terrain  depicted  be  representatively  varied. 

6.  That  the  selected  sample  contain  approximately  equal  proportions 
of  photo  pairs  in  which  the  scale  of  the  earlier  photo  was  1/4,  l/2, 
equal  to,  twice,  and  four  times  that  of  the  later  photo. 

All  the  images  were  black  and  white  vertical  photos  of  Camp  Drum, 

New  York.  All  photos  had  been  taken  during  the  summer,  except  for  one 
pair  in  which  both  photos  were  taken  in  winter  with  a  fairly  uniform 
snow  cover  present.  Number  and  distribution  of  target  types  and  addi¬ 
tional  descriptive  data  for  the  18  pairs  (original  scale  ratios,  image 
quality,  time  lapse,  type  of  change,  etc.)  are  given  in  Appendix  A 
(Table  A-l). 

To  maintain  equal  ground  area  coverage  in  the  two  photos  of  a  pair, 
photo  size  was  permitted  to  vary  with  the  adjustment  necessary  to  arrive 
at  the  desired  scale  discrepancy.  Thus,  whereas  the  most  recent  coverage 
(designated  Pa)  was  always  adjusted  to  and  displayed  in  a  9"  x  9"  format, 
the  earlier  coverage  (Px)  was  displayed  in  9”  x  9",  4.5"  x  4.5",  and 
2.25"  x  2.25”  format,  depending  on  the  scale  discrepancy  to  be  achieved. 

The  two  comparison  prints  were  positioned  and  affixed  to  the  opposing 
inner  surfaces  of  a  manila  folder.  When  the  folder  was  properly  oriented 
and  opened,  was  seen  on  the  right  and  Pj  on  the  left.  Ife  was  always 
positioned  parallel  to  the  lower  and  right  edges  of  the  folder  and 
oriented  so  that  its  identification  number  was  in  the  lower  right  corner. 
P1  of  each  pair  was  secured  on  the  opposing  surface  and  so  aligned  as  to 
produce  the  desired  orientation  discrepancy  relative  to  Efc  .  Figure  3 
illustrates  the  range  of  discrepancies  included  in  the  investigation. 
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Figure  3.  Illustration  of  comparative  photo  pair  presented  at  each  of  the  scale/orientstion 
discrepancy  levels. 


Other  Materials.  A  Response  Code  Sheet  (Figure  2)  established  the 
nine  target  categories  to  be  used  in  reporting  the  identification  of 
targets  detected,  and  the  five  types  of  target  change  to  be  determined 
and  assigned  to  each  target  reported.  Confidence  ratings  were  included 
in  order  to  simulate  more  closely  operational  procedures  in  which  it  is 
common  practice  for  interpreters  to  rate  their  confidence  in  the  infor¬ 
mation  they  report.  An  Immediate  Report:  Form  (Figure  4)  was  provided 
with  each  photo  pair  tc  standardize  the  target  reporting  format  and 
identify  subject,  experimental  condition,  and  stimulus  material. 

Each  subject  was  issued  a  9"  x  9”  transparent  celluloid  target 
localization  grid  ruled  off  into  144  consecutively  numbered  3/4"  square 
cells.  When  overlaid  on  the  right-hand  photo  of  each  comparative  pair, 
the  grid  provided  the  numerical  reference  system  for  reporting  the 
location  of  detected  targets.  Interpreter  keyB  for  the  identification 
of  U.  S.  military  vehicles  were  made  available  to  all  subjects. 


IMMEDIATE  REPORT  FORM 


Name 


Man  No. 


Figure  4.  Reproduction  of  Immediate  Report  Form  used  in  the  experiment 
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Procedure 


Subjects  were  tested  In  two  groups  of  lQ  each.  The  testing  was 
conducted  in  the  regularly  assigned  classrooms  at  the  U.  S.  Army  Intel¬ 
ligence  School  during  normal  duty  hours.  Upon  arrival,  the  subjects 
were  briefed  on  the  general  purpose  of  the  test  program  and  the  role 
they  were  to  play  in  it.  The  need  for  rigid  adherence  to  the  imposed 
test  controls  and  procedures  was  emphasized.  They  were  reassured  that, 
although  maximum  performance  was  sought,  the  results  of  the  testing 
would  not  appear  in  their  permanent  records  nor  influence  their  class 
grades. 

The  test  materials  were  then  distributed.  Each  subject  received 
18  manila  folders,  each  containing  one  pair  of  comparative-cover  photo¬ 
graphs,  and  18  Immediate  Report  Forms.  Each  subject  received  one  trans¬ 
parent  144-cell  9"  x  9"  target  location  grid,  one  Response  Code  Sheet, 
and  a  set  of  interpreter  keys  for  U.  S.  military  vehicles. 

A  detailed  explanation  and  demonstration  of  the  test  procedures  to 
be  followed  was  then  presented.  Major  points  were: 

Orientation  of  Test  Imagery  and  Target  Localizing  Grid .  Subjects 
were  cautioned  to  be  sure  that  the  small  tab  on  the  folder  was  oriented 
to  the  left-hand  side  of  the  folder.  To  report  the  location  of  a 
detected  target  they  were  to  position  the  144-cell  transparent  grid  over 
the  right-hand  photo  (which  was  always  the  same  size  as  the  grid)  with 
the  lower  left  corners  of  grid  and  Pa  photo  coincident. 

Order  of  Presentation.  Subjects  were  instructed  to  proceed  system¬ 
atically  from  photo  pair  1  through  pair  18  so  that  order  of  presentation 
was  the  same  for  all  subjects. 

Time  Limits .  Subjects  were  to  stop  working  when  their  allottp’ 
time  was  up,  and  not  begin  inspection  of  any  pair  of  photos  until  told 
to  do  so.  The  time  interval  under  which  each  subject  was  working 
appeared  on  the  front  of  his  folder.  When  the  end  of  the  5-minute  limit 
was  announced,  all  subjects  working  under  the  3-minute  condition  were  to 
stop  working  on  one  pair  and  wait  until  the  beginning  of  the  next  inter¬ 
val.  A  similar  procedure  was  followed  by  those  working  under  the  C-minute 
1 imit . 

Interpretation  Aids.  No  magnifiers  or  optical  aids  were  to  be 
used  during  the  test  session.  This  procedure  insured  preservation  of 
the  established  scale  discrepancy  between  Pj  and  P2  of  each  pair. 
Interpreter  keys  could  be  used  as  needed  for  target  identification,  but 
were  to  be  relied  upon  as  infrequently  as  possible. 

Recording  Responses .  Each  target  detected  was  to  be  numbered  and 
recorded  sequentially  on  the  Immediate  Report  Form.  Target  location  was 
reported  as  the  cell  number  on  the  transparent  grid  overlay  within  which 
the  target(s)  appeared.  Multiple  target  entries  were  permitted  where 
targets  were  tightly  clustered  and  were  all  of  the  same  category,  but 
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each  such  entry  had  to  contain  a  notation  of  both  number  and  type  (e.  g., 
('  x  1  indicated  six  tanks).  Each  target  detected  had  to  be  identified 
as  belonging  to  one  of  the  nine  target  categories  listed  on  the  Response 
Code  Sheet.  A  change  status  statement  (Unchanged,  Gone,  New,  Moved,  or 
Replaced)  had  to  accompany  each  detection  listed. 

Individual  responses  were  scored  by  comparing  each  report  of  a 
target  location,  identification,  and  change  status  with  "interpreter 
truth"  data  provided  by  a  team  of  experts  in  the  U.  S.  Army  Behavioral 
Science  Research  Laboratory.  The  interpreter  truth  for  each  target  on 
a  photo  pair--target  location  and  change  status--was  encoded  and  tran¬ 
scribed  on  punched  cards.  The  responses  to  these  targets  as  reported  by 
each  subject  were  similarly  encoded  and  transcribed  from  the  Immediate 
Report  Forms  to  the  same  cards.  Inventive  errors  were  identified  and 
entered  separately.  Comparison  of  the  transcribed  responses  given  by 
the  subject  with  interpreter  truth  yielded  quantitative  data  on  l)  number 
of  targets  correctly  detected  (and  by  subtraction,  number  omitted) ; 

2)  number  of  correctly  detected  targets  which  were  correctly  identified 
and  the  number  incorrectly  identified;  5)  number  of  correct  and  incorrect 
change  status  assignments;  and  4)  number  of  inventive  errors  committed 
along  with  number  of  erroneous  identifications  and  change  status  desig¬ 
nations  associated  with  the  inventive  error. 

Evaluative  Measures  ’  1 

From  the  response  data  available,  evaluations  of  interpreter  per¬ 
formance  were  derived  for  application  in  assessing  the  effects  of  the 
independent  variables.  Separate  measures  of  interpreter  performance 
were  computed  for  change  status  detection  without  identification  of 
target  and  for  change  status  detection  requiring  target  identification. 

Change  Status  Completeness .  The  completeness  of  interpretation  is 
the  ratio  of  the  number  of  correct  change  status  responses  to  the  total 
number  of  correct  change  status  responses  possible.  In  equation  form: 

rnMPTFTFNK<;<;  =  Number  of  Correct  Change  Status  Responses _ 

Total  Possible  Correct  Change  Status  Responses 

Change  Status  Accuracy.  The  accuracy  of  interpretation  is  the 
ratio  of  the  number  of  correct  change  status  responses  to  the  total 
number  of  change  status  responses  (both  correct  and  incorrect)  repo-ted 
by  the  interpreter  subject.  In  equation  form: 

ACCURACY  =  Number  of  Correct  Change  Status  Responses _ 

* . Total  Number  of  Change  Status  Responses  Reported 

To  provide  comparable  performance  measurement  units  from  photo 
pairs  containing  different  numbers  of  targets,  the  completeness  and 
accuracy  scores  of  each  subject  were  averaged  over  all  photo  pairs 
viewed  under  each  experimental  condition  to  yield  mean  performance 
figures  for  each  treatment  condition. 
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RESULTS 


Completeness  of  Change  Detection 

Change  Detection  without  Target  Identification.  Mean  completeness 
scores  for  change  detection  when  target  identification  was  not  required 
are  presented  In  Table  2.  Significant  differences  (p  <  .01)  were  associ¬ 
ated  with  main  effects  for  each  of  the  independent  variables  (see  analy¬ 
sis  of  variance  summary  table  B-l,  Appendix  B) .  No  significant  inter¬ 
actions  between  variables  were  found. 

As  anticipated,  more  complete  change  detection  reports  resulted 
from  increased  interpretation  time.  Although  the  absolute  magnitude  of 
the  difference  between  percent  change  detection  in  3  minutes  and 
40  percent  in  6  minutes  is  only  8  percentage  points,  this  increment 
represents  a  performance  improvement  of  25  percent.  Consistent  and 
reliable  performance  differences  of  this  magnitude  may  well  have  practi¬ 
cal  as  well  as  statistical  significance. 

The  effect  of  increasing  scale  discrepancy  was  to  degrade  complete¬ 
ness  of  change  detection  systematically.  Whereas  with  photos  of  equiva¬ 
lent  scale  approximately  40  percent  of  the  target  changes  were  detected, 
this  figure  was  reduced  to  36  percent  when  the  scale  of  one  photo  was 
one-half  that  of  the  other,  and  dropped  to  32  percent  when  the  scale 
difference  was  four  to  one.  Duncan's  new  multiple  range  test  revealed 
that  each  additional  increment  of  scale  disparity  produced  a  statistic¬ 
ally  significant  (p  <  .05)  decrement  in  completeness. 

Completeness  of  target  change  detection  also  declined  with  increased 
rotational  misalignment  between  members  of  a  comparative  photo  pair. 
Rotating  one  photo  90°  relative  to  the  other  resulted  in  a  statistically 
significant  (p  <  .05)  average  performance  decrement  of  approximately 
4  percent  (40$  vs  36$).  Increasing  the  orientation  discrepancy  from 
90°  to  180°  reduced  completeness  to  approximately  33  percent,  although 
this  decrement  was  not  statistically  different  from  performance  with  the 
90”  discrepancy.  Clearly,  interpreters  can  benefit  from  having  compara¬ 
tive  cover  displayed  in  the  proper  orientational  alignment. 

Change  Detection  with  Target  Identification.  Mean  completeness 
scores  for  change  detection  when  target  identification  was  a  required 
element  of  the  interpreter's  task  are  presented  in  Table  3.  The  results 
of  the  analysis  of  variance  are  presented  in  Table  B-2.  As  might  have 
been  predicted  in  view  of  the  contingency  relationship  between  target 
detection  and  subsequent  target  identification,  the  analysis  also  indi¬ 
cated  significant  performance  effects  for  each  of  the  three  experimental 
variables. 

An  increase  in  completeness  from  26  percent  to  32  percent  resulted 
from  increasing  interpretation  time  from  3  to  6  minutes,  a  relative 
performance  improvement  of  about  25  percent. 
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As  scale  discrepancies  Increased  front  equivalence  to  2  to  1  and 
4  to  1,  completeness  became  progressively  poorer  (33  percent  to  28  percent 
to  25  percent).  Each  additional  increment  of  scale  discrepancy  resulted 
in  significant  decrement  (p  <  .05)  in  performance. 

The  effect  of  increasing  orientation  discrepancy,  also  monotonic, 
was  less  pronounced.  Completeness  was  reduced  significantly,  from  32 
percent  to  28  percent,  as  orientation  misalignment  increased  from  0°  to 
90°.  As  misalignment  increased  to  180°,  a  statistically  nonsignificant 
(p  >  .05)  performance  drop  to  26  percent  was  observed. 


Accuracy  of  Change  Detection 

Change  Detection  without  Target  Identification.  Mean  accuracy  of 
change  detection  without  target  identification  is  shown  in  Table  4.  The 
results  of  the  analysis  of  variance  (Appendix  Table  B-3)  indicate  that 
accuracy  was  significantly  affected  by  scale  discrepancy  (p  <  .01)  and 
by  orientation  misalignment  (p  <  .05)  but  not  by  interpretation  time 
(p  >  .05).  None  of  the  variables  interacted  with  the  others  to  influence 
accuracy  of  performance  significantly. 

Accuracy  of  change  detection  without  target  identification  was 
neither  improved  nor  degraded  by  increasing  interpretation  time  from 
3  minutes  (73$  accuracy)  to  6  minutes  (71$)* 

Although  relatively  small,  consistent  and  reliable  reduction  in 
accuracy  was  found  to  accompany  each  increase  in  orientation  misalignment. 
From  a  mean  accuracy  of  75  percent  with  no  misalignment,  accuracy  de¬ 
creased  to  71  percent  with  90°  misalignment  and  to  69  percent  with  180° 
misalignment . 

The  effect  of  scale  disparity  was  slightly  more  pronounced.  With 
two  photos  of  equal  scale,  accuracy  averaged  approximately  77  percent. 

It  was  reduced  to  73  percent  with  a  scale  of  2  to  1  and  to  65  percent 
with  a  four  to  one  disparity.  The  difference  was  statistically  signifi¬ 
cant  at  the  .01  level. 

Change  Detection  with  Target  Identification.  When  target  identifi¬ 
cation  was  added  to  the  change  detection  task,  the  mean  accuracy  scores 
presented  in  Table  5  were  obtained.  Statistical  analysis  (Appendix  Table 
B-4)  indicated  that  only  scale  discrepancy  significantly  affected  accu¬ 
racy  of  performance.  Accuracy  did  not  vary  as  a  function  of  time  limit 
(58$  at  3  minutes,  56$  at  6  minutes).  With  orientation  misalignment, 
accuracy  fell  off  only  slightly--and  insignificantly--and  did  not  increase 
with  amount  of  difference. 

As  was  found  for  accuracy  of  detection  without  target  identification, 
the  only  statistically  significant  reduction  in  performance  occurred  when 
scale  discrepancy  was  increased  from  2  to  1  to  4  to  1  (58 $  vs  51$), 
although  both  scale  discrepancy  conditions  produced  accuracy  scores  less 
than  the  62  percent  obtained  when  scales  for  the  two  photos  of  a  pair 
were  the  same. 
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Analysis  of  Responses  in  Terms  of  Change  Status 

For  readers  who  are  interested  in  investigating  interpreter  response 
tendencies  in  greater  depth,  change  detection  data  in  relation  to  type  of 
change  is  presented  in  more  detail  in  Appendix  C.  Included  are  sumnary 
data  showing  the  distribution  of  correct  and  incorrect  responses  for  each 
type  of  change  (Table  C-l).  Figure  C-l  shows  the  distribution  of  errone¬ 
ous  change  status  assignments  across  the  change  categories.  To  facili¬ 
tate  comparison  between  change  categories  having  different  numerical  bases, 
the  frequency  data  have  been  converted  to  percentages.  Table  C-P.  gives 
the  raw  score  discributions.  Some  cursory  conclusions  and  speculative 
hypothesizing  about  casual  factors  are  offered. 


CONCLUSIONS 

Change  detection  is  most  complete  and  reports  on  target  change 
detected  are  more  accurate  when  the  aerial  photos  compared  are  the  same 
scale  and  are  displayed  with  a  conmon  directional  orientation.  Signifi¬ 
cant  decrement  in  completeness  and  accuracy  is  normally  associated  with 
additional  increments  of  scale  disparity  between  the  two  photos.  Both 
completeness  and  accuracy  were  degraded  also  when  the  two  photos  are  not 
displayed  in  the  same  directional  orientation.  A  small  degree  of  mis¬ 
alignment,  however,  appears  to  affect  completeness  more  than  it  does 
accuracy. 

These  results  provide  clear  indication  that  display  systems  for 
comparative  cover  analysis  should  include  scale  rectification  and  re¬ 
orientation  capability.  The  functional  relationship  between  scale  dis¬ 
parity  and  orientation  misalignment  needs  to  be  determined  so  that  recti¬ 
fication  capability  may  be  of  the  required  precision. 

Increasing  the  time  allowed  for  comparing  photos  can  offset  discrep¬ 
ancies  in  the  imagery--or  lack  of  corrective  devices--with  respect  to 
completeness.  Allowing  additional  time  does  not,  however,  appear  to  be 
effective  in  increasing  the  accuracy  of  change  detection  reports. 

| 
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APPENDIX  B 


RESULTS  OF  ANALYSES  OF  VARIANCE 


Table  B-l 

ANALYSIS  OF  VARIANCE  SUMMARY 

COMPLETENESS  SCORES  FOR  CORRECT  TARGET  CHANGE  STATUS  RESPONSES 
WITHOUT  TARGET  IDENTIFICATION 


Source  of 
Variation 

Degrees  of 
Freedom 

Sum  of 
Squares 

Mean 

Square 

F  Ratio 

Between  Sublects 

Subjects 

35 

4.340 

.124 

... 

Within  Sublects 

Time  (A) 

1 

1.138 

1.188 

37.03* 

Orientation  (B) 

2 

.657 

.328 

10 . 24* 

Scale  (C) 

2 

.798 

.399 

12.44* 

AxB 

2 

.140 

b 

0 

2.18 

BxC 

4 

.071 

.018 

•  56 

AxG 

2 

.009 

.004 

.14 

AxBxC 

4 

.lO? 

.026 

.82 

Photo  Pair 

17 

14.490 

.850 

26.50* 

Pooled  Error 

578 

18.540 

.032 

— 

TOTAL 

647 

40.299 

— 

— 

*P  <  .01 
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Table  B-2 


ANALYSIS  OF  VARIANCE  SUMMARY 


COMPLETENESS  SCORES  FOR  CORRECT  TARGET  CHANGE  STATUS  RESPONSES 
WITH  CORRECT  TARGET  IDENTIFICATIONS 


Source  of 
Variation 


Between  Sublects 


Subjects 

Within  Sublects 


Time  (A) 
Orientation  (B) 
Scale  (C) 

AxB 

BxC 

AxC 

AxBxC 

Photo  Pair 
Pooled  Error 
TOTAL 


Degrees  of 
Freedom 

Sum  of 
Squares 

35 

3.370 

1 

.630 

2 

.437 

2 

.741 

2 

.108 

4 

.027 

2 

.007 

4 

.095 

17 

13.446 

578 

13.480 

647 

32.340 

Mean 

Square 


F  Ratio 


Table  B-3 


ANALYSIS  OF  VARIANCE  SUMMARY 

ACCURACY  SCORES  FOR  CORRECT  TARGET  CHANGE  STATUS  RESPONSES 
NOT  REQUIRING  TARGET  IDENTIFICATIONS 


Source  of 
Variation 

Degrees  of 
Freedom 

Sum  of 
Squares 

Mean 

Square 

F  Ratio 

Between  Sublects 

Subjects 

"  :  j 

35 

5  • 34 

.101 

... 

Within  Sublects 

Time  (A) 

i 

.061 

.001 

.77 

Orientation  (B) 

2 

.475 

.257 

3.00* 

Scale  (C) 

2 

1.642 

.821 

10.41** 

AxB 

2 

•090 

.045 

•  57 

BxC 

4 

.118 

.029 

.37 

AxC 

2 

.041 

.021 

.26 

IxBxC 

4 

.445 

.111 

1.41 

Photo  Pair 

IT 

17.048 

1.003 

12.72** 

Pooled  Error 

578 

45.585 

.079 

... 

TOTAL 

647 

71.155 

— 

— 

*P  <  .05 
**P  <  .01 
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Table  B-4 


ANALYSIS  OF  VARIANCE  SUMMARY 


ACCURACY  SCORES  FOR  TARGETS  DETECTED,  CORRECTLY  IDENTIFIED 
AND  ASSIGNED  CORRECT  CHANGE  STATUS 


Degrees  of 
Freedom 

Sum  of 
Squares 

Mean 

Square 

55 

5-743 

.104 

1 

.071 

•  O';.  1 

2 

.406 

.203 

2 

1.4.37 

.744 

?. 

.523 

,161 

4 

.232 

.058 

2 

.229 

.114 

4 

.423 

.106 

IT 

23.331 

1.372 

573 

42.382 

.073 

047 

74.032 

... 

Source  of 
Variation 


Between  Subiects 


Subjects 

Within  Subiects 


T  ime  ( A) 
Orientation  (B) 
Scale  (C) 

Axb 

BxC 

AxC 

AxBxC 

Photo  Pair 
Pooled  Error 
TOTAL 


F  Ratio 


10 . 14* 


*P  <  .01 


APPENDIX  C 


CHANGE  STATUS  RESPONSE  ANALYSIS 

The  accompanying  tables  Indicate  that  when  the  same  targets  are  pres¬ 
ent  on  both  coverages,  targets  are  correctly  reported  as  unchanged  30*4% 
of  the  time.  Almost  half  the  time  (40$),  the  unchanged  targets  are  missed 
on  both  coverages.  On  23.6$  of  the  unchanged  target  presentations,  the 
targets  are  Incorrectly  recognized  as  being  other  than  the  same  on  both 
members  of  the  photo  pair.  When  unchanged  targets  are  incorrectly  reported, 
they  are  most  often  thought  to  be  "New"  targets.  That  is,  they  are  detected 
only  on  the  more  recent  Imagery  (P2).  This  result  may  be  partially  attri¬ 
butable  to  the  fact  that  it  was  always  the  imagery  which  was  reduced  in 
scale  relative  to  the  Pa  imagery  to  achieve  the  desired  scale  discrepancy 
levels.  However,  even  when  no  scale  or  orientation  discrepancy  existed 
between  the  P,  and  P2  imagery,  the  frequency  with  which  "New"  responses 
were  made  to  unchanged  targets  was  considerably  larger  than  for  "Gone" 
target  responses  (15  and  0  for  "New"  and  "Gone"  target  responses,  respec¬ 
tively;  see  Table  C-l).  The  second  most  frequent  error  response  for  un¬ 
changed  targets  was  to  say  that  they  were  "Moved"  targets.  This  would 
seem  to  indicate  that  subjects  had  difficulty  recognizing  that  the  location 
of  targets  detected  on  both  photos  was  the  same.  There  is  no  strong  indi¬ 
cation  that  this  location  comparison  becomes  more  difficult  as  the  discrep¬ 
ancy  between  image  samples  becomes  greater. 

Moved  targets,  of  which  there  were  only  three  in  the  stimulus  sample, 
were  omitted  approximately  half  the  time  (47.2$).  When  detected,  they 
were  correctly  recognized  as  "Moved"  targets  only  about  half  as  often  as 
they  were  incorrectly  reported  to  be  representative  of  some  other  change 
status.  Fifty  percent  of  the  incorrect  change  status  responses  for  moved 
targets  were  placed  in  the  unchanged  classification,  again  reflecting 
difficulty  in  comparing  target  positions.  As  was  found  for  Unchanged 
targets.  Incorrect  status  responses  for  moved  targets  also  revealed  a 
disproportionate  assignment  of  "New"  target  responses  (3 8.y$)  to  "Gone" 
target  responses  (8.3$)  for  a  situation  in  which  the  target  is  on  both 
images . 

The  largest  number  of  changes  in  status  represented  on  the  test 
imagery  used  in  this  study  was  that  of  "New"  targets.  Targets  in  this 
category  were  more  often  correctly  assigned  the  appropriate  change  status 
designation  than  were  any  others  (37-3$) •  Only  8.2$  of  the  new  targets 
were  correctly  detected  and  then  incorrectly  assigned  a  change  status. 

When  incorrect  change  status  responses  were  recorded  for  new  targets, 
there  was  about  a  50$  chance  that  the  target  would  be  called  "Unchanged" 
and  an  86.5$  chance  that  it  would  be  called  either  "Unchanged"  or  "Moved." 
These  incorrect  response  categories  imply  that  an  inventive  error  has 
also  been  made,  since  the  subject  is  ascribing  to  the  earlier  imagery  a 
target  which  is  not  there. 
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"Gone"  targets,  although  most  often  omitted  (71.45&),  were  least 
often  Incorrectly  reported  (3*5$) •  When  incorrectly  assigned  a  change 
status,  these  targets  are  designated  "Unchanged"  39*4$  of  the  time  and 
"Moved"  49-6$  of  the  time.  As  with  "New"  targets,  this  type  of  change 
status  error  also  implies  that  an  Inventive  error  has  been  made,  but  on 
the  later  coverage  where  no  target  actually  exists. 


Table  C-l 

SUMMARY  DISTRIBUTION  OF  CORRECT,  INCORRECT,  AND  OMITTED 
TARGET  RESPONSES  FOR  THE  DIFFERENT  CHANGE  STATUS  CATEGORIES 

(Percent) 


Change  Status 
Responses 

CHANGE 

STATUS  CATEGORIES 

Unchanged 
(N  ■  20)* 

Moved 

(N  *  3) 

New 

(N  -  148) 

Gone 

(N  -  110) 

Replaced 
(N  “  0) 

Correct 

30.4 

19.4 

37-3 

25.2 

0 

Incorrect 

23.6 

33.3 

8.2 

3.5 

100 

Omitted 

46.0 

47.2 

54.5 

71.4 

0 

TOTAL 

100 

100 

100 

100 

100 

'’N umber  of  targets  of  each  category  in  the  imagery 
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Table  C-2 

RAW  SCORE  DISTRIBUTIONS  OF  CHANGE  STATUS  RESPONSES  FOR 
TRUE  TARGET  CONDITIONS 
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1 
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65 

0 

0 
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0 
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1 

0 

0 
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0 

11 

2 

0 
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0 

19 

3 

0 
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0 
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1 

13 

2 

0 

0 

0 

5 

3 

0 

103 

2 

0 

6 

0 
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0 

0 
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1 

85 
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0 
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0 
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39 

0 
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1 
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2 

0 
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1 
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4 

0 

1 

3 
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0 

4 

2 

5 

4 

0 

83 

0 

0 

2 

1 

94 

0 

0 

4 

0 

89 

0 

0 

21 

68 

0 

0 

0 

0 

37 

0 

1 

0 

2 

31 

0 

1 

1 
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0 

0 

0 

0 

1 

0 

1 

0 

0 
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12  150 

7  1  150  0  0 

00  4  95  0 

0  0  0  0  0 

Ti  ii  8  l  o 

10  0  30  11  0 

4  2  140  7  0 

1  1  3  63  0 

0  0  0  0  0 

11  2  8  4  0 

5  0  16  8  0 

6  1  137  0  0 
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0  0  10  0 
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0  143  0  0 
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0  0  0  0 


2  140  0  0 

0  7  62  0 

0  0  0  0 
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1 

0 

22 

0 

17 

3 
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1 

0 

2 

2 

8 

2 

138 

0 

0 

10 

1 
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0 

0 

67 

0 

0 

0 

1 

0 

2 

0 

0 

0 

0 

0 
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Figure  C-t.  Distribution  of  total  change  status  arror  across  changs  status 
conditions.  { Figures  in  parentheses  ere  Ns  for  the  fetal  number  of 
change  status  error  responses  for  each  change  status  category.) 
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Research  Note  206  reports  on  a  study  of  the  need  for  devices  to  rectify  dis¬ 
parity  in  photo  scale  and  orientation  in  comparative-cover  photos  as  a  means  of  facili¬ 
tating  detection  of  change  in  the  status  of  targets  in  the  area.  Personnel  of  the 
Boeing  Company  and  of  the  INTERPRETER  TECHNIQUES  Work  Unit,  BESRL  jointly  conducted  an 
investigation  to  determine  the  extent  to  which  completeness  and  accuracy  of  Interpre¬ 
ters'  reports  of  change  are  dependent  on  the  essential  equivalence  of  the  imagery  being 
compared  and  to  determine  the  desirability  of  incorporating  scale  rectification  and 
rotational  capability  in  systems  for  displaying  comparative  cover  to  interpreters.  A 
further  objective  was  to  establish  the  amount  of  scale  disparity  in  comparative-cover 
photos  which  can  be  tolerated  before  a  decrement  results  in  interpreter  performance. 

The  experiment  assessed  the  effects  of  three  levels  of  scale  discrepancy  (1:1,  2:1,  and 
4:1),  three  levels  of  rotational  discrepancy  (0°,  90°,  and  l8o°),  and  two  time  limits 
(3  minutes  and  6  minutes)  on  the  completeness  and  accuracy  of  change  detection. 

Student  image  interpreters  (N  "  36)  participated  in  the  experiment  under  two  require¬ 
ments  --  one  to  detect  change  in  objects  characterized  only  as  target  or  non-target, 
the  other  to  identify  the  target  as  belonging  to  one  of  nine  target  categories  listed 
on  a  Response  Code  Sheet.  Each  of  18  different  pairs  of  comparative-cover  scenes  in 
which  tactical  military  targets  appeared  was  viewed  once  by  each  subject  under  each  of 
the  treatment  conditions.  Written  reports  were  prepared  by  each  interpreter  for  the 
18  photo  pairs  viewed.  Individual  responses  were  scored  by  comparing  each  report  of  a 
target  location,  identification,  and  change  status  with  "interpreter  truth"  data-- 
target  location  and  change  status- -provided  by  a  team  of  experts  in  BESRL.  Performance 
evaluations  were  computed  in  terms  of  change  detection  completeness  and  change 
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